Statistics of unstable periodic orbits of a chaotic dynamical system with a large 

number of degrees of freedom 



Mitsuhiro Kawasakjj 

Department of Materials Science and Technology, Niigata University, Niigata 950-2181, Japan 

Shin-ichi Sasc0 

Department of Pure and Applied Sciences, University of Tokyo, Tokyo 153-8902, Japan 

(Dated: February 8, 2008) 

For a simple model of chaotic dynamical systems with a large number of degrees of freedom, we 
find that there is an ensemble of unstable periodic orbits (UPOs) with the special property that 
the expectation values of macroscopic quantities can be calculated using only one UFO sampled 
from the ensemble. Evidence to support this conclusion is obtained by generating the ensemble by 
Monte Carlo calculation for a statistical mechanical model described by a space-time Hamiltonian 
that is expressed in terms of Floquet exponents of UPOs. This result allows us to interpret the 
recent interesting discovery that statistical properties of turbulence can be obtained from only one 
UFO [G. Kawahara and S. Kida, J. Fluid Mech. 449, 291 (2001); S. Kato and M. Yamada, Phys. 
Rev. E 68, 025302(R)(2003)]. 



PACS numbers: 05.45. Jn,05. 45. Ra,05.20.Gg,05.10.Ln 

A wide range of systems, including fluid turbulence and 
ecosystems, can be described by chaotic dynamical sys- 
tems (CDSs) with a large number of degrees of freedom. 
Because the evolution equations describing them are non- 
linear and possess many degrees of freedom, analyses em- 
ploying various theoretical tools fail. For instance, it is 
difficult to characterize quantitatively the intermittency 
of fluid turbulence using perturbative expansion methods 
applied to the Navier-Stokes equation [l| . 

In contrast, for CDSs consisting of assemblies of 
molecules at equilibrium, equilibrium statistical mechan- 
ics provides a powerful framework to predict macroscopic 
properties without the need to analyze a Hamiltonian 
equation for a large number of molecules. The success of 
equilibrium statistical mechanics relies on its probabilis- 
tic description: In order to predict macroscopic proper- 
ties, the exact probability distribution for states is not 
needed. Rather, the existence of many degrees of free- 
dom allows a tractable distribution to reproduce macro- 
scopic properties correctly. When considering macro- 
scopic properties of a CDS with many degrees of freedom, 
it is tempting to think that a probabilistic approach other 
than analyzing evolution equations can be employed by 
finding a useful probability measure for the system. 

Although it would be extremely difficult to find a useful 
measure for general CDSs, it was suggested recently that 
an ensemble of states that describes macroscopic proper- 
ties of CDSs can be constructed from a special unstable 
periodic orbit (UPO) 0, 01 • The first study of such a 
UPO demonstrated that the spatial profiles of the mean 
and variance of the velocity in minimal wall turbulence 
can be extracted from only one UPO of the Navier-Stokes 
equation Subsequently, the scaling exponents of ve- 
locity fluctuations, which characterize the intermittency 
of a turbulent velocity field, was found to be obtained 



from only one UPO in the GOY shell model 01 ■ 

To obtain both of these interesting results, the UPOs 
were found in numerical computations such as the 
Newton-Raphson method applied to a function of 15,422 
variables ^ and following the destabilization of a limit 
cycle resulting from a bifurcation process in the GOY 
model with 24 degrees of freedom ;.3]. Because there are 
other UPOs which yield properties that differ from those 
of the special UPOs, it can be considered that these spe- 
cial UPOs were selected out of infinitely many UPOs un- 
der some criterion. However, such a criterion for choos- 
ing UPOs is still unknown, because in the previous works 
the initial value for the Newton-Raphson method and the 
path of the destabilization of the limit cycle were found 
by trial and error. Given this situation, the objective of 
the present work is to formulate a method to construct an 
ensemble of special UPOs such that macroscopic proper- 
ties can be obtained with high accuracy even when only 
one UPO element of the ensemble is used. 

In this Letter, we present analysis in which such a UPO 
ensemble is obtained for a CDS with many degrees of free- 
dom. Note that here, the term "macroscopic quantities" 
refers to quantities obtained by taking the average over 
many degrees of freedom of the system. Furthermore, the 
term "macroscopic properties" is used to mean the lead- 
ing terms of the expectation values of the macroscopic 
quantities with respect to the natural invariant measure 
when the number of degrees of freedom is large. 

Model: Here, we explain the model analyzed in the 
present work. First, we note that it is not necessary to 
study turbulence for our present purpose. Rather, it may 
be preferable to analyze a simple model for which many 
UPOs can be found easily. With this idea, we studva 
coupled map lattice (CML) proposed by Sakaguchi 
which we now describe. Let {xi,/^i) G [—1,1] x [—1,1] 



2 



be dynamical variables defined on the i-th site of a one- 
dimensional lattice consisting of N lattice points num- 
bered from to TV — 1 5j. For later convenience, the 
variable s*i, which is called the "spin", is defined as 



+1 (-1 <x^< A,), 
-1 (A, <x^< 1). 

The time evolution of {xi, A^) is given by 



(1) 



(x*+^,A*+\) = (/(xS,A*J,tanh 



) 

'(2) 

ioi i^t+l (mod 2) and A*+i J = (a;*,. A* J for 

i — t (mod 2). Here is a positive parameter, and the 
local map /(a;*^, A*j) is the Bernoulli map, given by 



f(x*- A* ) = ^(^*» + ^*'') 



(3) 



Note that the discontinuous point of the map f{x, A) is 
located at x = A, and the spin variable, Si, is identified to 
a symbol of the symbolic dynamical system for the local 
map f{xi,Ai). Hereafter, we call the above CML the 
"Bernoulh CML" and denote it X*+^ = F(X*), where 
X*^{x\,A\}l-\ 

The Bernoulli CML has interesting features, as demon- 
strated by Sakaguchi First, the natural invariant 
measure for spin configurations coincides with the canon- 
ical distribution for an Ising spin Hamiltonian. In order 
to express this fact explicitly, we define J(s) as the set 
of states {xi, Ai}^^ corresponding to the spin config- 
uration s = {sijj^Q^. Then, it is found that the nat- 
ural invariant measure on the set J(s) can be written 
as /i(J(s)) = const, x exp[(fc/2) ^-^^"^ SiS^+i]. Further- 
more, when the initial probability distribution of states is 
the natural invariant measure, it is known that the tran- 
sition probability T{s\s') from one spin configuration s 
to another s' is given by T(s2*|s2*+i) = UfJo'^i'^ + 
s2*+i2.+iA2*+i2,+i)/2,T(s2*+i|s2*+2) ^ nfio"'(l + 

A UPO ensemble: We now proceed to construct a 
UPO ensemble for the Bernoulli CML with the prop- 
erty that the expectation values of macroscopic quan- 
tities are obtained with high accuracy even when only 
one UPO element of the ensemble is used. As the first 
step in this construction, we demonstrate that there is 
a one-to-one correspondence between symbol sequences 
and UPOs. Suppose that a symbol sequence [s] = 
(s°, S"^, . . . , s^"^) is given. We then attempt to find a 
periodic point X° = {a;°i, A°j}^g^ corresponding to [s]. 
The A^-tuple {A'^^y^J^^ can be determined directly from 
the given symbol sequence by definition. A component 
of XP = FP{X°) is given by = nt=o~^ a^\x^i + 

where it is assumed that p is an even number and 



a*i = 2/(1 + s*,A\). Because n?=o~^ ^ 1 
arbitrary symbol sequence, we can uniquely determine 
the point satisfying the periodicity condition x'^i = x^i. 
In this way, we can find a point X'^ = {x^t, A'^^}^J^^ 
such that X° = XP for a given symbol sequence [s]. 
Conversely, it should be confirmed that the symbol se- 
quence generated from the point X'^ coincides with [s]. 
We numerically confirmed this for 10^ symbol sequences 
generated randomly. On the basis of these results, we 
conclude that there exists a single UPO corresponding 
to an arbitrary symbol sequence. 

Because of the one-to-one correspondence between 
UPOs and symbol sequences, we can obtain a UPO 
ensemble through the construction of an ensemble of 
symbol sequences. One natural possibility for a prob- 
ability measure (PM) on symbol sequences is the fre- 
quency distribution of symbol sequences in the case that 
the initial probability distribution of states is given by 
the natural invariant measure. The frequency distribu- 
tion of a symbol sequence [s] is expressed as ^"([5]) = 
/i(J(s"))r(sO|si)r(si|s2)...T(sP-i|sP). Although this 
expression appears to take a simple form, it is not easy to 
derive the natural invariant measure for most dynamical 
systems. In order to analyze a wide variety of dynamical 
systems, it is convenient to use a more tractable PM that 
yields the same macroscopic properties as those obtained 
from P([s]). As one such possibility, we consider the PM 
(5([s]) obtained by replacing the natural invariant mea- 
sure /i in P([s]) with a constant Z~^. This PM can be 
rewritten as 



g([s]) =exp[-ln|D(")FP(X")|]/Z. 



(4) 



Here, |L>(")FP(X")| is the absolute value of the prod- 
uct of the eigenvalues in the expanding directions of the 
Jacobi matrix for the map given by p iterations of the 
coupled map F evaluated at the periodic point X° cor- 
responding to the symbol sequence [s], and Z is a nor- 
malization constant. The expression of frequency distri- 
bution of a symbol sequence has been obtained in Ref. 
6J. The PM defined by Eq. can be calculated more 
easily for any CDS than that defined by ^'([s]). 

Numerical demonstration: Now we describe the nu- 
merical demonstration that a macroscopic property for 
the CML can be determined with high accuracy even 
when only one UPO element of the ensemble determined 
by Eq. Q is used to provide ensembles of states. First, 
we note that the sampling of UPOs according to Eq. 
can be carried out using the Monte Carlo method. In 
this procedure, a symbol sequence [s] is regarded as a 
spin configuration on a 1 -I- 1-dimensional p x N lattice, 
where p and N correspond to the time and space direc- 
tions, respectively. In addition, the PM given by Eq. Q 
is of the same form as the canonical distribution. Hence, 
the UPO ensemble we seek can be generated with the 
Metropolis algorithm, regarding ln\D'-''^FP{X°)\ as the 
"Hamiltonian" of a 1 + 1-dimensional Ising model with 
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FIG. 1; Averages (solid circles) and standard deviations (er- 
ror bars) of ejv evaluated from 50,000 samples of UPOs for 
the case = 2" (3 < n < 12), fc = l,p = 64. The broken hne 
represents the exact value in the limit A'' — > oo, — tanh(l/2). 



spins [s]. In order to obtain UPOs, periodic boundary 
conditions are imposed at the boundaries of the lattice 
in the time direction, t = and t = p — 1. 

For each UPO of period p, an ensemble of spin configu- 
rations s, which can be regarded as an ensemble of states, 
can be constructed by assuming the equal weight proba- 
bility l/p on each spin configuration of the sequence [s] 
corresponding to the UPO. Using this ensemble associ- 
ated with one UPO, we consider the ensemble average 
of the macroscopic quantity — X^iLo^ SiSi+i/N, given by 
En = -E?=o Ej^o^ ■s*iS*i+i/(A^p). In Fig. [H the aver- 
age and standard deviation of Eat calculated from 50,000 
samples of UPOs generated by the Monte Carlo method 
are displayed for several values of A^. It is seen that as 
N increases, the standard deviation approaches zero and 
the average value of e^v converges to — tanh(fc/2), which 
is the value calculated from the natural invariant mea- 
sure ^(J(s)). This implies that in the limit A^ —^ oo, the 
expectation value of —J2i=o^^i^i+i/^ with respect to 
the natural invariant measure can be calculated from the 
ensemble of states obtained from only one UPO, because 
the discrepancy between the value calculated from one 
UPO and that from another UPO has turned out to be 
ignored. This is the main result of the present Letter. 

Single-UPO description: It is worthwhile to note that 
our result can be understood for a wide class of CDSs 
with large degrees of freedom. First, let us consider re- 
laxation processes to the steady state in such a CDS pro- 
vided that a smooth initial measure is given. Then, the 
expectation value of a quantity that is a function of a 
symbol, A{s), converges to the same value in a relax- 
ation time TA, irrespective of initial measures. Thus, the 
asymptotic value for the case that the initial measure is 
assumed to be flat, where the frequency distribution of 
the symbol sequence is equal to Q([s]), coincides with 
the value for the case that the initial measure is given 



by the natural measure fi, whose value is nothing but 
the expectation value of A{s) with respect to fj,. This 
is expressed simply as (A(s*))q = ^[s] — 
{A{s))fj_ = J2s the time range t > ta- 

Next, by using this generic property, we can es- 
timate the expectation value of the time average of 

M^) as {eVoM^')/?)^ ^ Elto'{Ms'))Q/p+ip- 
ta){A{s)) ^/p. When the period p is taken to be 
long compared to the relaxation time ta, we obtain 

Yrt=lA{s')/p)^^{A{s)),- 



Finally, we consider the case where A{s) is a macro- 
scopic quantity such as En- The law of large num- 
bers asserts that fluctuations of such a quantity be- 
come negligible when the degrees of freedom is large and 
steady state is settled. Hence, for almost all symbol se- 
quence [s] sampled according to Q([s]), Y^^Zo A{s*')/p ~ 

Yl'tZlA{s^)/p) 



Consequently, Ym.=o -^i^*) / P — almost all 

[s] with respect to (5([s]). It means that the time average 
along single UPO sampled according to (5([s]) provides 
a good approximate value of (ylAf(s)}^t. Since the dis- 
cussion presented above is based on generic properties 
of CDSs with many degrees of freedom, it is highly ex- 
pected that description of macroscopic properties with 
single UPO can be appHed for a wide class of systems. 

Interpretation of the UPO description of turbulence: 
We now interpret the UPO description of turbulence 
0, 1^ based on our result. In particular, we discuss the 
relationship between the UPOs employed in Refs. 0, Q 
and the UPOs sampled according to Eq. 

In the methods of searching for UPOs employed in the 
two previous works, a trial initial state point is first cho- 
sen near a true periodic point in some way, and the 
time development of the state is traced by numerical inte- 
gration of the governing equation. Then, the initial point 
is recognized as a periodic point if the distance between 
the orbit and the trial initial state point at the time that 
the orbit returns closest to the trial initial state point is 
less than some threshold value 5. 

For simplicity, suppose that a set of trial initial state 
points are scattered within a hypersphere of radius 5q 
centered at a periodic point X''^ of period p. Then, 
this set expands in the unstable direction as the system 
evolves in time. Specifically, assuming that du is the di- 
mension of the unstable manifold and 5o is sufficiently 
small, the volume of the set in the unstable direction be- 
comes (5q" |I?*^"^i^P(Ar°)| after one period of motion along 
the UPO starting from X'^ . Hence, the probability that 
the distance between the orbit and the trial initial state 
point after one period of motion remains less than the 
threshold 5 is estimated as d"^^ /{5^^\D'^''^Ft>{X^)\). This 
implies that the probability of finding numerically an ap- 
proximate periodic point around X''^ is proportional to 
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|£)('')i?p(XO)|-i, which is equal to the quantity appear- 
ing in Eq. (0J. From these considerations, we conjecture 
that the UPOs found in the previous works 0, y| were 
sampled from a probability measure that takes a form 
similar to Eq. for turbulence. 

In order to demonstrate the correspondence between 
the single-UPO description of turbulence and our result 
that the expectation value of a quantity averaged over 
many degrees of freedom can be obtained from only one 
UPO, one task remains: We must show that the quan- 
tities analyzed in Refs. 0, Q were also averaged over 
many degrees of freedom. First, the quantities investi- 
gated in the case of wall turbulence '2| were averaged 
on a plane parallel to the walls. Next, consider whether 
the scaling exponents of the turbulent velocity field an- 
alyzed in Ref. Q can be expressed in an averaged form 
over many degrees of freedom. By making use of no- 
tions on the energy cascade and self-similarity in the 
inertial subrange, the scaling exponent of order q, Cg, 
can be derived as Q = q/3 — ln((ej+i/ej)'/'^), where 
ej is the energy dissipation rate at the j-th shell 0- 
Self-similarity makes the statistical average (•) replace- 
able with the average over shells in the inertial subrange 

as ((e,+i/e,)'/') ^ (1/^^) Ef=o'(^.+i A.)^/'- Thus, the 
scaling exponent (^q can be expressed as a quantity aver- 
aged over identically distributed variables. 

One may wonder whether the numbers of statistically 
independent variables in the systems studied in Refs. 
[3,13 are sufficiently large to ensure that the UPOs sam- 
pled according to Eq. (0J should actually to yield values 
close to the true expectation value. However, as seen in 
Fig.n the results for the cases = 8 and 16 indeed pro- 
vide good approximations of the true expectation value. 
Therefore, in the turbulence problems, we believe that 
the numbers of statistically independent variables are suf- 
ficient to provide good approximations. 

Discussion : The statistical analysis of symbol se- 
quences for orbits in dynamical systems is called the 
"thermodynamic formalism" |^ 0. The Monte Carlo 
calculation of Eq. Q can be regarded as a numerical real- 
ization of the thermodynamic formalism for the Bernoulli 
CML. In similar studies, the explicit construction of the 
space-time Hamiltonian for spatially extended dynami- 
cal systems was proposed in Ref. [lOj, though its con- 
struction is based on a natural invariant measure that 
happened to be obtained for specific models. 

Let us briefly discuss the range of applicability of our 
method. In hyperbolic dynamical systems, employing 
the periodic orbit expansion, the natural invariant mea- 
sure fi on a set R in phase space can be expressed as 
= limp^ooEj l-C'^"^i^P(^j)r\ where the sum is 
taken over all the fixed points Xj of F^, i.e., UPOs, 
in the set R 0, 0, 0|. From this expanded form, it 



turns out that the weight of a UPO is proportional to 
Because this factor has the same form 
as Eq. 0), our method can be applied to general hyper- 
bolic systems. In related studies, some CDSs with many 
degrees of freedom have been analyzed using the periodic 
orbit expansion technique [ij, [la, llal • In contrast to the 
expansion employing many UPOs, we have demonstrated 
that only one UPO sampled according to Eq. is suffi- 
cient to provide a description of macroscopic quantities. 

In summary, we have demonstrated that the macro- 
scopic properties of the Bernoulli CML can be calculated 
with high accuracy using only one UPO sampled from 
the special UPO ensemble described by Eq. Q). 
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